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Sensor  Networks  with  Multiple  UAS 
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*  Applications 

■Nature  Monitoring  -  Civil 
(Disaster,  Forest  Fire,  Weather) 

■Surveillance  &  Coverage  -  Military 
(SA,  Decision  Support,  ISR) 

■Remote  Sensing  -  Science 
(GIS,  Ocean  Map  Building,  etc) 


Research  Goals  &  Issues 
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♦> 


Research  Goals 


□  Dispatch  a  swarm  of  networked  UAVs  as  communication  relay 
nodes  for  real-time  decision-making  support  and  situational 
awareness 


♦» 


Research  Goals  &  Issues 
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Research  Issues _ 

□  High  Bandwidth  Communication  Links  (Max.  Throughputs) 

□  Wide  Area/Range  Coverage  (Network  Coverage  Control) 

□  Long-Term  Communication  Relay  (Aerial  Platforms) 
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Objective  and  Approach 


□Develop  control  algorithms  that  allow  UAVs  to  reposition 
themselves  autonomously  at  optimal  flight  location  to 
maximize  the  communications  link  quality 


Strategy 
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♦♦♦Control  Method 


^Methods  for  controlling  flying  platforms  to  operate  ^ 

continually  at  the  maximum  point  of  a  performance 
function  can  be  termed  real-time  optimization  or 

,  extremum  control 
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❖  Real-Time  Optimization 

>  Cost  Function  :  Communication  performance 

>  Constraint  :  UAV  positioning  equation 


max  Jk (x, )  subject  to  xt+1  =f(xk,uk) 

\keD 


□  Cost  Function  (J) 

/  \ 

)  =  J(Xk  ’  yk  ’  Zk  ’  Qk  9  Xnode,i  ) 

\ _ / 


xBOrfe>|.  =  communications  nodes  (xA. 9yk9zk9</>k)  =  UAV  position  and  attitude  (bank) 


□  Equations  of  3D/2D  UAV  Motion 


/<X) 


.{**+■  =  x*+vcos(^)At 
J*+i  =>’*+vsin(^)A/ 


where  v  is  body-axis  speed  and  y/h  is  the  yaw  angle  of  the  vehicle 
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❖  Real-Time  Optimization 

>  If  partial  derivatives  of  the  cost  function  are  known 

>  Solution:  Extremum  Control  (Gauss-Newton  Optimization) 


x*+i  =x*+u*  =**-atHjI(xt)V/(xt) 


where  h t=/>,(xj  = 


d2J 


f 


dxi,t8xj,t 


(xt),  VJ(xt)  = 


dJ 


V&u 


(x*)> 


dJ 


dx 


K) 


n,k 


J 


>  Issue:  3-D  Complex  Optimization  Problem 

J(Xk  ’  34  ’  Z/fc  ’  ’  X7io<fe,/  )  =  ’  ||^||) 


where 


sf^^uav  X  node )  34o£fe)  (Zwav  ^  node ) 
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Methodology 
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❖ 


Gradient-Type  Extremum  Control 


>  Measured  SNR  is  discontinuous  and  slow  (1  Hz) 

>  Subjective  to  noise  and  cluttered  environment 

>  Affected  by  the  orientation  of  a  UAV  (fast  maneuver) 


f - \ 

V  Computation  of  gradient/hessian  values  is  nontrivial 

V _ / 


❖  Approaches  and  Solutions 

>  Mathematical  Communications  Modeling 

■  Provide  continuous  reference  values  at  fast  mode 

■  Predict  a  maximum  operation  point 


>  Model-Free  Adaptive  Extremum  Control 

■  Gradient  is  obtained  by  numerical  method  without  model 

■  Robust  to  noise  and  cluttered  environment 
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1  4_ 

SNR  Model  for  Cost  Function 

l  L  ~ 
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□Why  Signal-to-Noise  Ratio  Model 


where  C  is  channel  capacity  (bits  per  second)  W  -  bandwidth  (Hz)  of  the  channel 

S Channel  capacity  (C)  is  proportional  to  the  SNR  and  the  bandwidth  (W) 

□  Signal-to-Noise  Ratio  (SNR)  Model 


where  Pr(dBm)  is  the  receiver  power  Pn (dB)  is  noise  power  (-95  dBm) 

Gr(dB)  is  receiver  antenna  gain  Gr(dB)  is  transmitter  antenna  gain 

n 

A  =  c  /  f  where  /  is  the  transmission  frequency  c  =  3x10^  m/s  d  =  distance 


Lp{dB)=  (4/7  cl 

/  X y  is  path  loss 

Lq.  ( dB )  is  antenna  pattern  loss 
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Antenna  Pattern  Loss  on  SNR 

\  m  —  ~__1 
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□  Model  for  UAV  Orientation  Effects 


>  Antenna  Pattern  Loss  :  Function  of  Arrival  Angle  r,(t) 


r,  (0  =  -8,  (0  -  f Kt)  sin  ( t )  -  Y(tj) 


which  is  the  angle  between  the  incident  ray  and  horizontal  wing  of  a  UAV 

r  \ 


<9.  (?)  =  tan 


-1 


(Z(0  -Znode,i) 


f 


(pt  (t)  =  tan 


-i 


A 


*(0  -  , 


<p(t)  is  the  UAV  bank  angle  yAf)  is  the  heading  angle  of  the  UAV  (f)  is  the  bearing  angle 
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SNR  Map  Example 
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□  Static  SNR  Map  in  East-North-Up  coordinates 

>  Fixed  altitude,  heading  &  bank  angle 

>  Path  loss,  Antenna  pattern  loss 


SNR  Map  (3-D  View) 


SNR  Map 


Altitude:  1500  m 
Bank  Anele:  0  de? 
Heading:  East 


4000  -3000  3000  -1000  0  1000  2000  3000  4000  9000 

East 

SNR  Map  (2-D  Top  View) 
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Self-Tuning  Extremum  Control 


Center  for  Autonomous  Vehicle  Research 


Naval  Postgraduate  School 


□  Use  on-line  gradient  estimation  of  SNR  function  to 
drive  the  set  point  to  its  max  location 

□  On-line  estimator  does  not  require  a  precise  model 


SNR 


Self-Estimating  Extremum  Control  Architecture 
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On-Line  Gradient  Estimator 
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□  Perturbation  Based  Gradient  Estimator 

>  The  purpose  is  to  make  q.q *  as  small  as  possible,  so  that 
the  output  is  driven  to  its  minimum  J * 


(Stability  Proof  by  Kristie,  2001) 


■  Applying  high-pass  filter  (differentiator)  gets  rid  of  constant  term  and  leads  to 


Vh 


dJ 

«  a  —  sin  wt 
SO 
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1  4_ 

On-Line  Gradient  Estimator 

I  L  -r-*-  ~ 
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Demodulating  Vh  with  sinwv  divides  the  signal  into  a  low-frequency  signal  and 
high-frequency  signal 


1  dJ 
c  =  —a  — 

2  dG 


1  dJ 
- a 


0=0 


2  dG 


cos  2  wt 


0=0 


Applying  low-pass  filter  (integrator)  gets  rid  of  the  sinusoidal  term  and  provides  an 
estimate  of  the  gradient  of  j(G) 

1  dJ 


yT  «  —  a  — 
L  2  dG 

The  estimated  gradient  can  be  expressed  by  th 

0=6 

e  parameter  change 

l 

I  i.k'-aSJ 

2  dG 

Self-Tuning  Estimator 

Denote  Q  =  G-G*  the  convergence  error,  and  taking  a  derivative  of  the  errors  leads  to 

0  =  0  «  k^aj"{ 0')0 

❖  which  become  stable  with  a  proper  choice  of  the  parameter,  a  and  k  i.e.,  kaJ"(G*^<  0 
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Autonomous  Controller  Design 
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□  How  Self-Tuning  Extremum  Control  Works  ? 

>  Key  idea  is  to  integrate  an  on-line  gradient  estimator  into  an 
extremum  control  to  get  optimal  location  for  UAVs 


□  Consider  2-D  Motion  in  {/}  Frame 

fix  V  {*W  =  vWC0S(^aW) 

'  [jKO  =  v(t ) sin ( V'a (0) 

V _  _ _ _ _ _ / 

where  v  is  body-axis  speed  and  y/h  is  the  yaw  angle  of  the  vehicle 

□  Motion  with  Constant  Speed 

/  \ 

x(t)  =  V  cos  (Wk(t))  =  fi(Vh  ) 

y(t)  =  v  sin  ( y/h  (t ) )  =  f2  (y/h  (t),  y0 ) 
v _ _ _ / 

where  v  =  const 
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Autonomous  Controller  Design 
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□  Then  SNR  function  becomes  an  implicit  function  of  heading  angle 

/  \ 

J  =  SNR  (x(t),  y(t))  =  SNR  (x(¥h  (t)),  y{Vh  (/))) 

V _ 1 _ J 

□  Gradient  Descent  Extremum  Control  is  expressed  by 

/"  \ 

Yk+x  =V'k+ak  yjv 
\ _ / 

where  =  dJ  /  8 y  e 

□  Assume  that  SNR  is  a  quadratic  function 

wif)  is  the  current  heading  angle  estimate 

\ 

J  is  the  maximum  attainable  value  of  the  cost  function.  w(f)  is  a  zero-mean  white  noise 
j.i  is  the  sensitivity  of  the  quadratic  curve  Unknown 

w  is  the  heading  angle  maximizing  J 


J  (y(tj)  =  f  +Qy  (0  -  v  f  +  w(t) 
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Adaptive  Convergence  Control 
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>  Adaptive  Convergence  Rate  ak 


□  Armijo-Wolfe  Conditions 


J  (xk  +  akdk  )<J(xk)  +  cxakdTkWJ  (xk ) 

alvj(xt+akak)>c2ayj(xt) 

the  Armijo  condition  that  prevents  steps  that  are  too  long 
the  Wolfe  condition  which  restricts  steps  that  are  too  short 

□  Adaptive  Convergence  Control  Law 


a 


k+ 1 


=  y  a k ,  where 


0</<l,  if  SJk+]  >  r 
y  >  1,  else  A Jk+X  <  r 


where  o  <  q  <  c2  <  l 


|  where 

A/jt+l  =  ^k+l  ~  01  ^ ^ 

T  :  a  specified  threshold  value 


Vcom  (0  -  Yss  if  I  Ycom  it)  -  yss  =  V  /  Rss  \  <  e 

Worn  (0  =  Vss  +  H  r  a(t)  yf(t)  Other 


u  (t)  =  < 

com  V  / 


ss 
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Autonomous  Heading  Controller  Design 
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Applying  On-Line  Gradient  Estimator 


™r<0  - 


a/ Q(Q)  , d 
<¥(0 


,  -(v^(0)=/.(Oo) 


□  Then  the  extremum  controller  is  expressed  by 


Oom(0  =  ^  =  «(0^-(vJr) 


dt  dt 


On-line  Gradient  Estimator 


Cc(t)  \  step  length  along  the  direction  VJ  Optimal  value  can  be  obtained  by  Armtjo-Wolfe  conditions 

□  Orbit  Circle  Guidance  at  Final  Steady-Stage 

;  \ 

Ycon  (0  =  Yss  if  \vcom  (0 -ysss  =v/ Rss\<  ess 

W com  (0  =  ¥ss  +  A  «(0  ^(0  0ther 


y/„  is  introduced  to  guarantee  that  the  UAV  will  orbit  with  a  constant  radius  R::  at  the  final  stage 
Rss  =  v  /  y/ss  :  a  final  approach  circle  radius. 
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Flight  Test  Systems 
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Rascal  110  UAV  (ARF  Airframe) 


Onboard  PCI  04  &  Payload  Stack 


Avionics  bay  of  Rascal  UAV  Mobile  GCS 


❖  Rapid  Flight  Test  Design  Keys 

□  Reduce  development  time 

□  Upgrade  is  flexible 

□  Convenience  of  high  level  programming 


Tracking  antenna  and  Wave  Relay  mesh  link  Gimbal  Camera 
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Model  Verification  Flight  Test 
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L  AV  Flight  Path 


3  dB  Omni- 
Directional  Antenna 


9  dB  Sector  Antenna 
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SNR  Model  Verification 
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SNR  (dB)  between  UAV  and  GCS  (Contour  Map) 


East  (m) 


Movie 


SNR  Model  Verification  with  respect  to  UAV  Trajectories 


SNR  Model  Verification 
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SNR  at  Rascal's  <2D)  Trajectory  (01  Aug  08) 


0  dB  10  dB  20  dB  25  dB  30  dB  35dB 

SNR  Variation  with  respect  to  UAV  Trajectories 
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Comparison  with  SNR  Model 
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SNR  Error  Plots  Between  Real  and  Model  Values 
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High  Band  Comms  Flight  Test 
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❖  Flight  Test  (Nov.  20,  2008) 

>  Validate  the  designed  onboard  adaptive  self-tuning 
controller  &  the  communication  models 


Network  Coverage  Control  using  Extremum-Seeking  Control 


29 


Naval  Postgraduate  School 


Flight  Test  Set-Up 
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Sensor  Node  Locations  &  Flight  Setup  in  Camp  Roberts 


GCS 
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UAV  Trajectory  over  SNR  MAP 
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UAV  Trajectory  Control  for  Max  Communication  Links  (SNR) 


(Movie) 
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UAV  Path  over  SNR  Map 
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Plot  of  UAV  Trajectory  over  SNR  Maps 
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SNR  Model  Errors 
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%  in  Error  between  Actual  and  Simulated  SNR  Data 


<5%  <15%  <30% 


Plot  of  SNR  Errors  Between  Model  and  Observation  Ones 
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Conclusions 
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□  Communication  Propagation  Model 
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>  Communication  propagation  model  was  developed,  which 
include  the  effects  of  the  path  loss,  antenna  pattern  loss, 
and  the  orientation  of  aerial  platforms 


Proposed  models  were  validated  through  real  flight  tests 


□  Self-Tuning  Extremum  Control  for  UAVs  Location 

>  On-lie  adaptive  gradient  estimator  was  integrated  into  an 
extremum  control  architecture 

>  Proposed  self-estimating  extremum  control  is  robust  to 
even  low  signal-to-noise  ratio  signal 

>  Effectiveness  of  the  self-tuning  optimizer  was  validated 
through  real  time  flight  tests 


□Applicable  for  Decentralized  Network  Coverage  Control 
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